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DETAILED ACTION 

Specification 

1 . The incorporation of essential material in the specification by reference to an 
unpublished U.S. application, foreign application or patent, or to a publication is 
improper. Applicant is required to amend the disclosure to include the material 
incorporated by reference, if the material is relied upon to overcome any objection, 
rejection, or other requirement imposed by the Office. The amendment must be 
accompanied by a statement executed by the applicant, or a practitioner representing 
the applicant, stating that the material being inserted is the material previously 
incorporated by reference and that the amendment contains no new matter. 37 CFR 

1 .57(f). The priority claim (foreign priority or 371 of PCT) has to be specified either in 
the beginning of the specification or ADS. The applicant submits a mere copy of WIPO 
for both specification and claims and drawing, which do not have priority claim. The 
examiner recommends a separate set of specification and claims and drawing while 
WIPO documents are made as support of 371 of PCT. 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

3. Claim 14 is rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. 
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A) . The Examiner notes that "comprising instructions..." does not specify how the 
instructions are (a) associated with the medium, or (b) the nature of instructions. Data 
structures not claimed as embodied (or encoded with or embedded with) in a computer 
readable medium are descriptive material per se, and are not statutory, Warmerdam, 33 
F.3d at 1361, 31, USPQ2d at 1760). Specifying the association in the manner listed 
above would sufficiently address the first condition. Similarly, computer programs 
claimed as computer listings, instructions, or codes are just the descriptions, 
expressions, of the program are not "physical things". They have neither computer 
components nor statutory processes, as they are not "acts" being performed. In 
contrast, a claimed "... computer readable medium encoded with a computer program..." 
is a computer element which defines structural and function interrelationships between 
the computer program and the rest of the computer, and is statutory, ~ 32 F.3d at 1583- 
84, 32 USPQ2d at 1035. Specifying the instructions as a "computer program" would 
sufficiently address the second condition, Interim Guidelines. Annex IV (Section a). 

B) . Lastly, the computer program as claimed doesn't isn't properly associated 
with the operation. It is quite possible that the computer program may be an unrelated 
sub-routine or a simple commence instruction which then causes the computer to 
execute the operation that could be self-resident, and not encoded on the medium. The 
Examiner suggests that the computer program be more directly associated with the 
operation. Interim Guidelines. Annex IV (Section b). Corrections to the claims, and 
supporting specification are required. 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kobayashi (US 5,619,268) in view of Liu (US 5,398,068), hereafter referenced as 
Kobayashi and Liu respectively. 

Regarding claim 1, Kobayashi discloses A method of motion estimation, the first 
motion vector field (forward and backward motion vectors ) being computed, on basis of 
a first image (reference Picture B, Fig.49) and a second image (reference Picture C, 
Fig.49) of a sequence of images, for a temporal position (past and future frames of the 
current frame, Fig.49) between the first image and the second image. However, 
Kobayashi fails to disclose the method comprising: 

- establishing a first group of un-referenced pixels in the first image, by 
selecting a first set of mutually connected pixels of the first image for which the first 
motion vector field does not comprise respective motion vectors; 

- establishing a second group of un-referenced pixels in the second image, by selecting 
a second set of mutually connected pixels of the second image for which the first motion 
vector field does not comprise respective motion vectors; 

- computing a match error of a candidate motion vector, which is oriented from 
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the first group of un-referenced pixels to the second group of un-referenced pixels; and 

- comparing the match error with a predetermined match threshold and 
assigning the candidate motion vector to the first one of the motion vectors of the 
second motion vector field if the match error is below the predetermined match 
threshold. 

In the same field of view, Liu discloses Method and Apparatus for Determining 
Motion Vectors. Specifically Liu discloses Motion Estimation Using Sparse Pixel 
Patterns (Fig. 10) which uses selected pixels such as Fig. 14 (non-selected pixels are 
un-referenced pixels because they are not used for motion vector estimation), for the 
purpose of reducing the complexity for motion estimation ( col.4, line 52-54). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time invention was made to modify Kobayashi by providing motion estimation using 
sparse pixels patterns, for the purpose of reducing the complexity for motion estimation. 
The Kobayashi Motion estimation method, incorporating the Liu motion estimation using 
sparse pixels patterns, teaches the method comprising: 

- establishing a first group of un-referenced pixels (Liu: light pixels in Fig. 14) in the first 
image (Kobayashi: reference picture B, Fig.49), by selecting a first set of mutually 
connected pixels (Liu: light pixels in Fig. 14) of the first image for which the first motion 
vector field does not comprise respective motion vectors (Liu: Light pixels at Fig. 14 are 
Not Used for Motion Estimation); 

- establishing a second group of un-referenced pixels (Liu: light pixels in Fig. 14) in the 
second image (Kobayashi: reference picture B, Fig.49), by selecting a second set of 
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mutually connected pixels (Liu: light pixels in Fig. 14) of the second image for which the 
first motion vector field does not comprise respective motion vectors (Liu: Light pixels in 
Fig. 14 are Not Used for Motion Estimation). 

However, The Kobayashi Motion estimation method, incorporating the Liu motion 
estimation using sparse pixels patterns, still fails to disclose computing a match error of 
a candidate motion vector, which is oriented from the first group of un-referenced pixels 
to the second group of un-referenced pixels; and comparing the match error with a 
predetermined match threshold and assigning the candidate motion vector to the first 
one of the motion vectors of the second motion vector field if the match error is below 
the predetermined match threshold. 

However, Kobayashi discloses computing a match error of a candidate motion 
vector, which is oriented from the first group of un-referenced pixels to the second group 
of un-referenced pixels (Fig. 51 , forward and backward motion vector interpolation by 
scaling motion vector between two references based on temporal distance between 
current and a reference frame). Therefore, it would have been obvious to change the 
first one of the motion vector if the block match error with this motion estimation is below 
the predetermined match threshold, for the purpose of improvement of the motion 
vector accuracy. 

Therefore, it would have been obvious to modify Kobayashi and Liu to provide 
computing a match error of a candidate motion vector, which is oriented from the first 
group of un-referenced pixels to the second group of un-referenced pixels; and 
comparing the match error with a predetermined match threshold and 
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assigning the candidate motion vector to the first one of the motion vectors of the 
second motion vector field if the match error is below the predetermined match 
threshold, for the purpose of improvement of the motion vector accuracy. The 
Kobayashi Motion estimation method, incorporating the Liu motion estimation using 
sparse pixels patterns, further incorporating computing a match error of a candidate 
motion vector, which is oriented from the first group of un-referenced pixels to the 
second group of un-referenced pixels and comparing the match error with a 
predetermined match threshold and assigning the candidate motion vector to the first 
one of the motion vectors of the second motion vector field if the match error is below 
the predetermined match threshold, has all the features of claim 1 . 

Regarding claim 2, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 1 , discloses whereby 
establishing the second group of un-referenced pixels is based on the first group of un- 
referenced pixels (the same sparse pixel pattern as Fig 14). 

Regarding claim 3, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
match error of a candidate motion vector, which is oriented from the first group of un- 
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referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 2, discloses whereby 
establishing the second group of un-referenced pixels is based a spatial environment 
(location) of the first group of un- referenced pixels and on a particular motion vector 
(because the first motion vector gives the approximate of the optimum motion vector, so 
motion search can be sought at its neighborhood ) which belongs to the first motion 
vector field and which is located in the spatial environment of the first group of un- 
referenced pixels. 

Regarding claim 4, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 2, discloses whereby 
establishing the second group of un-referenced pixels is based a spatial environment 
(location) of the first group of un- referenced pixels and null vector (because it was well 
known in the art that the zero motion vector is optimum motion vector in most time). 

Regarding claim 5, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
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match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 1 , discloses whereby 
establishing the second group of un-referenced pixels is based on computing overlap 
between the first group of un-referenced pixels and a candidate group of un-referenced 
pixels in the second image (Liu: determine shift vector minimizing SAD (sum of absolute 
difference), col. 7, line 44-49). 

Regarding claim 6, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 1 , discloses whereby a 
first number of pixels of the first group of un-referenced pixels is above a first 
predetermined count threshold, because the number of first group of un-referenced 
pixels is fixed number in Liu and therefore it can be above a first predetermined count 
threshold 

Regarding claim 7, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
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match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 1 , discloses whereby a 
first number of pixels of the first group of un-referenced pixels is below a second 
predetermined count threshold, because the number of first group of un-referenced 
pixels is fixed number in Liu and therefore it can be below a second predetermined 
count threshold. 

Regarding claim 8, the Kobayashi Motion estimation method, incorporating the 
Liu motion estimation using sparse pixels patterns, further incorporating computing a 
match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 1 , discloses whereby 
establishing the match error comprises computing differences between respective pixel 
values of the first and second group of un-referenced pixels ((Liu: determine shift vector 
minimizing SAD (sum of absolute difference), col.7, line 44-49)). 

Regarding claim 9, the claimed invention is an apparatus claim corresponding to 
the method claim 1 . Therefore, it is rejected for the same way as claim 1 . 
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Regarding claim 10, the Kobayashi Motion estimation apparatus, incorporating 
the Liu motion estimation using sparse pixels patterns, further incorporating computing 
a match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 9, discloses An image 
processing apparatus (400) (Liu: Fig. 3) comprising: receiving means (402) for receiving 
a signal (Liu: l n (n-th Frame), Fig. 3) corresponding to a sequence of input images; and 
an image processing unit (404) for calculating a sequence of output images (Liu: f , 
Fig. 3) on basis of the sequence of input images (Liu: Subtracter 25, Fig. 3 which subtract 
input by Motion Compensation) and on basis of the second motion vector field (Liu: 
Motion Compensation, Fig. 3) being provided by the conversion unit for converting 
(further incorporating computing a match error of a candidate motion vector, which is 
oriented from the first group of un-referenced pixels to the second group of un- 
referenced pixels and comparing the match error with a predetermined match threshold 
and assigning the candidate motion vector to the first one of the motion vectors of the 
second motion vector field if the match error is below the predetermined match 
threshold). 

Regarding claim 11, the Kobayashi Motion estimation apparatus, incorporating 
the Liu motion estimation using sparse pixels patterns, further incorporating computing 
a match error of a candidate motion vector, which is oriented from the first group of un- 
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referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 10, discloses 
characterized in further comprising a display device (406) (HDTV, col. 1 , line 21 ) for 
displaying the output images. 

Regarding claim 12, the Kobayashi Motion estimation apparatus, incorporating 
the Liu motion estimation using sparse pixels patterns, further incorporating computing 
a match error of a candidate motion vector, which is oriented from the first group of un- 
referenced pixels to the second group of un-referenced pixels and comparing the match 
error with a predetermined match threshold and assigning the candidate motion vector 
to the first one of the motion vectors of the second motion vector field if the match error 
is below the predetermined match threshold, as applied to claim 1 1 , discloses 
characterized in that it is a TV (HDTV, col. 1 , line 21 ). 

Regarding claim 13, claim 10 has all the features of the claimed invention, 
because the image processing apparatus in claim 10 is video encoding unit with the 
conversion unit as claimed in claim 9. Therefore, it is rejected for the same reason as 
claim 10. 

Regarding claim 14, the claimed invention is a computer readable medium claim 
corresponding to the method claim 1 . Therefore, it is rejected for the same way as claim 
1. 
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Conclusion 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HEE-YONG KIM whose telephone number is (571)270- 
3669. The examiner can normally be reached on Monday-Thursday, 8:00am-5pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on 571-272-7905. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 

you have questions on access to the Private PAIR system, contact the Electronic 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 

USPTO Customer Service Representative or access to the automated information 

system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/HEE-YONG KIM/ 
Examiner, Art Unit 2621 

/Andy S. Rao/ 

Primary Examiner, Art Unit 2621 
June 2, 2010 



